Situations that prompt teachers in problem-based curricula to reflect on their beliefs, identity and mission.

Teachers have different perceptions of how to enhance student learning. Whereas some take a teacher-centred perspective, others lean more towards a student-centred approach. Many studies in higher education have invoked Korthagen's onion model (2014) to explain how teachers' perspectives can impact their teaching practices. Spanning six interrelated layers, this model contains both outer (environment, behaviour, competencies) and inner (beliefs, identity, and mission) aspects. Focusing essentially on teachers' outer aspects, previous studies have paid scant attention to how particular situations affect teachers' inner aspects and, consequently, how teachers perceive student-centred learning. In this descriptive qualitative study, we explored situations that encouraged or discouraged teachers to embrace student-centred beliefs, identities and missions. We held three focus-group discussions with 18 teachers from two Indonesian medical schools, performing a thematic analysis of the data thus obtained. We found that certain situations made teachers reflect on their inner aspects, which either favourably or adversely affected their acceptance of a student-centred learning approach. Teachers' outer aspects (i.e. their prior problem-based teaching and learning experiences, learning situations from their own training as well as clinical duties) strongly interacted with their inner aspects, thereby shaping their teaching perspectives. Understanding how specific situations can influence teachers' inner aspects might help institutions to design faculty development programmes that address teachers' specific educational needs.

The Effects of Reflective Pauses on Performance in Simulation Training.

INTRODUCTION: The reflective pause, taking a pause during performance to reflect, is an important practice in simulation-based learning. However, for novice learners, it is a highly complex self-regulatory skill that cannot stand alone without guidance. Using educational theories, we propose how to design cognitive and metacognitive aids to guide learners with the reflective pause and investigate its effects on performance in a simulation training environment. METHODS: These effects are examined in four aspects of performance: cognitive load, primary performance, secondary performance, and encapsulation. Medical students ( N = 72) performed tasks in simulation training for emergency medicine, under 2 conditions: reflection condition ( n = 36) where reflection was prompted and guided, and control condition ( n = 36) without such reflection. RESULTS: The effects of reflective pauses emerged for 2 aspects of performance: cognitive load decreased and secondary performance improved. However, primary performance and encapsulation did not show significant difference. CONCLUSIONS: The results demonstrate that reflective pauses with cognitive and metacognitive aids implemented can enhance some aspects of performance. We suggest that to secure these effects, feedback during reflection and an adaptation period should be provided.

The Balancing Act of Assessment Validity in Interprofessional Healthcare Education: A Qualitative Evaluation Study.

CONSTRUCT & BACKGROUND: In order to determine students' level of interprofessional competencies, there is a need for well-considered and thoroughly designed interprofessional assessments. Current literature about interprofessional assessments focuses largely on the development and validation of assessment instruments such as self-assessments or questionnaires to assess students' knowledge or attitudes. Less is known about the design and validity of integral types of assessment in interprofessional education, such as case-based assessments, or performance assessments. The aim of this study is to evaluate the evidence for and threats to the validity of the decisions about students' interprofessional performances based on such integral assessment task. We investigated whether the assessment prototype is a precursor to practice (authenticity) and whether the assessment provides valid information to determine the level of interprofessional competence (scoring). APPROACH: We used a design-based qualitative research design in which we conducted three group interviews with teachers, students, and interprofessional assessment experts. In semi-structured group interviews, participants evaluated the evidence for and threats to the validity of an interprofessional assessment task, which were analyzed using deductive and inductive content analysis. FINDINGS: Although both evidence for and threats to validity were mentioned, the threats refuting the assessment's validity prevailed. Evidence for the authenticity aspect was that the assessment task, conducting a team meeting, is common in practice. However, its validity was questioned because the assessment task appeared more structured as compared to practice. The most frequently mentioned threat to the scoring aspect was that the process of interprofessional collaboration between the students could not be evaluated sufficiently by means of this assessment task. CONCLUSIONS: This study showed that establishing interprofessional assessment validity requires three major balancing acts. The first is the balance between authenticity and complexity. As interprofessional practice and competencies are complex, interprofessional tasks require build-up or guidance toward this complexity and chaotic practice. The second is that between authenticity and scoring, in which optimal authenticity might lead to threats to scoring and vice versa. Simultaneous optimal authenticity and scoring seems impossible, requiring ongoing evaluation and monitoring of interprofessional assessment validity to ensure authentic yet fair assessments for all participating professions. The third balancing act is between team scoring and individual scoring. As interprofessional practice requires collaboration and synthesis of diverse professions, the team process is at the heart of solving interprofessional tasks. However, to stimulate individual accountability, the individual performance should not be neglected.

Developing student-centred perspectives in PBL: how teacher profiles reveal educational needs for faculty development programmes.

BACKGROUND: In Asian higher education, PBL is not always successful, as few teachers have embraced a student-centred perspective. To cultivate such essential perspectives, faculty development programmes should address teachers' specific educational needs, which sadly is currently not sufficiently the case. This study aimed to identify teacher profiles that would reveal these specific educational needs of teachers and to investigate the relationship between these profiles and the amount of PBL training previously received. METHODS: To identify the said profiles, we performed latent profile analysis on a stratified random sample of 543 teachers based on a survey of teaching perspectives on the six aspects of Korthagen's onion model of reflection (environment, behaviour, competencies, beliefs, identity and mission). Additionally, we employed Chi-square and Mann-Whitney tests to investigate the aforementioned relationship. RESULTS: We identified six teacher profiles that resemble the diffusion of innovations theory's classification of innovation adopters: Innovators, Early adopters, Early majority 1, Early majority 2, Late majority and Laggards. The Chi-square test demonstrated that the amount of PBL training received did not differ significantly across profiles, although teachers with a more innovative profile had undergone slightly more PBL training. The Mann-Whitney test furthermore revealed for three profiles that more PBL training was associated with a higher overall score for student-centredness. When aspects were considered separately, however, this was not the case. CONCLUSIONS: The findings confirmed that current faculty development programmes are not sufficiently tailored to teachers' needs. We therefore propose that faculty development programmes be redesigned to address teachers' specific educational needs as reflected in the profiles based on the 6 aspects of the onion model. We expect such a tailored approach to more effectively promote the development of student-centred perspectives.

Second language learning role-play: effects of patient and doctor roles on motivation and competence.

Objectives: Role-playing has motivated foreign language learners for decades. In doctor-patient medical consultation role-plays, the doctor role has always been considered an important learning opportunity, whilst the patient role remained obscured. Our study, therefore, had a dual focus. We first explored how intrinsic motivation changes medical second-language (L2) learning through the lens of self-determination theory. We subsequently examined if playing the role of the patient provides additional value to medical L2 learning. Methods: We performed a mixed-methods study using a one-group pretest-posttest design. Participants were 15 student volunteers learning medical Dutch through peer role-play in medical consultations. Students completed a questionnaire before and after the course that measured changes in their intrinsic motivation to experience stimulation (IMES), feeling of relatedness, and feeling of competence. We also measured students' competence through a peer-rated checklist and the final course grades. At the end of the course, the students participated in semi-structured interviews to discuss their experience acting as patients. The data were subjected to the Wilcoxon signed-rank test and a thematic analysis. Results: The pre- and post-questionnaires revealed that students' IMES as well as their feeling of relatedness increased. Their self-perceptions, feeling of competence, peer assessments, and final course grades demonstrated that students were competent in medical L2. Our thematic analysis led to the identification of five themes of the role-play exercise for medical L2 learning: (1) motivational experience, (2) supportive peer interaction, (3) setting up a role-play environment for medical L2 learning, (4) utilizing the patient role to benefit medical L2 learning, and (5) a novel patient perspective on the doctor's role. Discussion: Our study found that role-play, by enhancing students' intrinsic motivation, feeling of relatedness, and competence development, aids the medical L2 learning process. Interestingly, playing a patient role in medical consultation was also found to support this process. We welcome future controlled experiments to confirm the positive impact of playing the role of the patient in medical consultation.

Critical design choices in healthcare simulation education: a 4C/ID perspective on design that leads to transfer.

BACKGROUND: Healthcare simulation education often aims to promote transfer of learning: the application of knowledge, skills, and attitudes acquired during simulations to new situations in the workplace. Although achieving transfer is challenging, existing theories and models can provide guidance. RECOMMENDATIONS: This paper provides five general recommendations to design simulations that foster transfer: (1) emphasize whole-task practice, (2) consider a cognitive task analysis, (3) embed simulations within more comprehensive programs, (4) strategically combine and align simulation formats, and (5) optimize cognitive load. We illustrate the application of these five recommendations with a blueprint for an educational program focusing on simulation activities. CONCLUSIONS: More evidence-informed approaches to healthcare simulation might require a paradigm shift. We must accept that a limited number of simulations is not enough to develop complex skills. It requires comprehensive programs that combine simulation sessions with workplace learning.

Design guidelines for assessing students' interprofessional competencies in healthcare education: a consensus study.

INTRODUCTION: Healthcare systems require healthcare professionals and students educated in an interprofessional (IP) context. Well-designed assessments are needed to evaluate whether students have developed IP competencies, but we currently lack evidence-informed guidelines to create them. This study aims to provide guidelines for the assessment of IP competencies in healthcare education. METHODS: A qualitative consensus study was conducted to establish guidelines for the design of IP assessments using the nominal group technique. First, five expert groups (IP experts, patients, educational scientists, teachers, and students) were asked to discuss design guidelines for IP assessment and reach intra-group consensus. Second, one heterogeneous inter-group meeting was organized to reach a consensus among the expert groups on IP assessment guidelines. RESULTS: This study yielded a comprehensive set of 26 guidelines to help design performance assessments for IP education: ten guidelines for both the IP assessment tasks and the IP assessors and six guidelines for the IP assessment procedures. DISCUSSION: The results showed that IP assessment is complex and, compared to mono-professional assessment, high-quality IP assessments require additional elements such as multiple IP products and processes to be assessed, an IP pool of assessors, and assessment procedures in which standards are included for the IP collaboration process as well as individual contributions. The guidelines are based on expert knowledge and experience, but an important next step is to test these design guidelines in educational practice.

Managing uncertainty in decision-making of common congenital cardiac defects.

Decision-making in congenital cardiac care, although sometimes appearing simple, may prove challenging due to lack of data, uncertainty about outcomes, underlying heuristics, and potential biases in how we reach decisions. We report on the decision-making complexities and uncertainty in management of five commonly encountered congenital cardiac problems: indications for and timing of treatment of subaortic stenosis, closure or observation of small ventricular septal defects, management of new-onset aortic regurgitation in ventricular septal defect, management of anomalous aortic origin of a coronary artery in an asymptomatic patient, and indications for operating on a single anomalously draining pulmonary vein. The strategy underpinning each lesion and the indications for and against intervention are outlined. Areas of uncertainty are clearly delineated. Even in the presence of "simple" congenital cardiac lesions, uncertainty exists in decision-making. Awareness and acceptance of uncertainty is first required to facilitate efforts at mitigation. Strategies to circumvent uncertainty in these scenarios include greater availability of evidence-based medicine, larger datasets, standardised clinical assessment and management protocols, and potentially the incorporation of artificial intelligence into the decision-making process.

The limited use of instructional design guidelines in healthcare simulation scenarios: an expert appraisal.

BACKGROUND: Systematic reviews on simulation training effectiveness have pointed to the need to adhere to evidence-based instructional design (ID) guidelines. ID guidelines derive from sound cognitive theories and aim to optimize complex learning (integration of knowledge, skills, and attitudes) and learning transfer (application of acquired knowledge and skills in the workplace). The purpose of this study was to explore adherence to ID guidelines in simulation training programs for dealing with postpartum hemorrhage (PPH), a high-risk situation and the leading cause of maternal mortality worldwide. METHODS: A total of 40 raters analyzed simulation training programs as described in 32 articles. The articles were divided into four subsets of seven articles and one subset of four articles. Each subset was judged by seven to ten raters on adherence to ID guidelines. The 5-point Likert score rating scale was based on Merrill's First Principles of Instruction and included items relating to key ID features categorized into five subscales: authenticity, activation of prior knowledge, demonstration, application, and integration/transfer. The authors searched for articles published in English between January 2007 and March 2017 in PubMed, Eric, and Google Scholar and calculated the mean Likert-scale score, per subscale, and interrater reliability (IRR). RESULTS: The mean Likert-scale scores calculated for all subscales were < 3.00. For the number of raters used to judge the papers in this study (varying between 7 and 10), the IRR was found to be excellent for the authenticity and integration/transfer subscales, good-to-excellent for the activation of prior knowledge and application subscales, and fair-to-good for the demonstration subscale. CONCLUSION: The results demonstrate a paucity of the description of adherence to evidence-based ID guidelines in current simulation trainings for a high-risk situation such as PPH.

Development of a questionnaire to measure teachers' student-centred perspectives based on the Onion Model.

BACKGROUND: Teachers with a teacher-centred perspective have difficulties applying student-centred approaches in Problem Based Learning (PBL) because they are inclined to show teacher-centred behaviours. The six aspects explained in Korthagen's Onion Model (environment, behaviour, competencies, beliefs, identity, and mission) are assumed to contribute to teachers' perspectives, showing that both the environment and personal characteristics influence behaviours. For teachers to function properly in PBL, those six aspects should reflect a student-centred perspective. Previous instruments to measure teaching perspectives focused on only a few of these relevant aspects. Therefore, we developed the Student-Centred Perspective of Teachers (SCPT) questionnaire with subscales for each aspect in the Onion Model. This study aimed to provide evidence for its internal and external validity. METHODS: The SCPT was distributed in a survey to 795 teachers from 20 medical schools. For the internal validation, Confirmatory Factor Analysis was performed to analyse theoretical fit model validation, convergent validation, and discriminant validation. For the external validation, teachers' perspective scores were compared among three groups of amount of PBL training using Analysis of Variance (ANOVA) and post-hoc Least Significant Difference (LSD) tests. The p-value for all tests was set at .05. RESULTS: A total of 543 out of 795 teachers (68.3%) participated. Confirmatory Factor Analysis showed the evidence of the SCPT's internal validation with acceptable fit for the six subscales measured by 19 items and the following Composite Reliability scores: environment (.72), behaviour (.74), competencies (.63), beliefs (.55), identity (.76), and mission (.60). All items' factors loadings reached a good standard (.5 or greater). Only the environment subscale had the Average Variance Extracted (AVE) score higher than .5 and the Maximum Shared Variance score lower than the AVE score. ANOVA and Post-hoc LSD tests showed that teachers who participated in more PBL training showed significantly higher student-centred perspectives, providing evidence for external validity. CONCLUSION: The SCPT is a reliable and valid instrument to measure teaching perspectives. Identifying aspects that do not represent the adoption of a student-centred perspective may provide valuable input for faculty development in the context of PBL.

The Validity of Physiological Measures to Identify Differences in Intrinsic Cognitive Load.

A sample of 33 experiments was extracted from the Web-of-Science database over a 5-year period (2016-2020) that used physiological measures to measure intrinsic cognitive load. Only studies that required participants to solve tasks of varying complexities using a within-subjects design were included. The sample identified a number of different physiological measures obtained by recording signals from four main body categories (heart and lungs, eyes, skin, and brain), as well as subjective measures. The overall validity of the measures was assessed by examining construct validity and sensitivity. It was found that the vast majority of physiological measures had some level of validity, but varied considerably in sensitivity to detect subtle changes in intrinsic cognitive load. Validity was also influenced by the type of task. Eye-measures were found to be the most sensitive followed by the heart and lungs, skin, and brain. However, subjective measures had the highest levels of validity. It is concluded that a combination of physiological and subjective measures is most effective in detecting changes in intrinsic cognitive load.

Holistic processing only? The role of the right fusiform face area in radiological expertise.

Radiologists can visually detect abnormalities on radiographs within 2s, a process that resembles holistic visual processing of faces. Interestingly, there is empirical evidence using functional magnetic resonance imaging (fMRI) for the involvement of the right fusiform face area (FFA) in visual-expertise tasks such as radiological image interpretation. The speed by which stimuli (e.g., faces, abnormalities) are recognized is an important characteristic of holistic processing. However, evidence for the involvement of the right FFA in holistic processing in radiology comes mostly from short or artificial tasks in which the quick, 'holistic' mode of diagnostic processing is not contrasted with the slower 'search-to-find' mode. In our fMRI study, we hypothesized that the right FFA responds selectively to the 'holistic' mode of diagnostic processing and less so to the 'search-to-find' mode. Eleven laypeople and 17 radiologists in training diagnosed 66 radiographs in 2s each (holistic mode) and subsequently checked their diagnosis in an extended (10-s) period (search-to-find mode). During data analysis, we first identified individual regions of interest (ROIs) for the right FFA using a localizer task. Then we employed ROI-based ANOVAs and obtained tentative support for the hypothesis that the right FFA shows more activation for radiologists in training versus laypeople, in particular in the holistic mode (i.e., during 2s trials), and less so in the search-to-find mode (i.e., during 10-s trials). No significant correlation was found between diagnostic performance (diagnostic accuracy) and brain-activation level within the right FFA for both, short-presentation and long-presentation diagnostic trials. Our results provide tentative evidence from a diagnostic-reasoning task that the FFA supports the holistic processing of visual stimuli in participants' expertise domain.

An exploratory investigation of the measurement of cognitive load on shift: Application of cognitive load theory in emergency medicine.

BACKGROUND: Emergency physicians often experience a high cognitive load (CL) due to the inherent nature of working in acute care settings. CL has traditionally been measured in educational studies but has not been well studied in the clinical environment. METHODS: Emergency medicine attending physicians and residents working in an academic urgent care center completed psychometric questionnaires while on shift to measure overall CL, intrinsic cognitive load (ICL), extraneous cognitive load (ECL), and acute stress. Data regarding the patient load, patient acuity, and the number of patients in the waiting room were also collected. Correlational analysis and simple linear regression were used to evaluate predictors of CL on shift. RESULTS: Forty-two questionnaires were completed (26 by attending physicians, 16 by residents). Attending physicians carried a significantly higher patient load compared to residents (p < 0.001). No differences in mean overall CL, ICL, ECL, and acute stress were observed between attending physicians and residents. Bivariate analysis demonstrated associations between ICL, ECL, acute stress, and overall CL in attending physicians. In residents, acute stress was the only variable associated with overall CL and the number of high-acuity patients was associated with ICL. CONCLUSIONS: Factors influencing reported CL during clinical work are different between attending emergency physicians and residents. Further study to appreciate the impact of these differences is required and may help educators elucidate strategies to better manage CL, thereby improving clinical performance and potentially improving patient care.

Development and validation of teacher and student questionnaires measuring inhibitors of curriculum viability.

BACKGROUND: Curriculum viability is determined by the degree to which quality standards have or have not been met, and by the inhibitors that affect attainment of those standards. The literature reports many ways to evaluate whether a curriculum reaches its quality standards, but less attention is paid to the identification of viability inhibitors in different areas of the curriculum that hamper the attainment of quality. The purpose of this study is to develop and establish the reliability and validity of questionnaires that measure the presence of inhibitors in an undergraduate medical curriculum. METHODS: Teacher and student questionnaires developed by the authors were sent to medical educationalists for qualitative expert validation and to establish their content validity. To establish the response process validity, cognitive interviews were held with teachers and students to clarify any confusion about the meaning of items in the questionnaires. Reliability and construct validity of the questionnaires were established by responses from 575 teachers and 247 final-year medical students. RESULTS: Qualitative expert validation was provided by 21 experts. The initial teacher and student questionnaires containing respectively 62 items to measure 12 theoretical constructs, and 28 items to measure 7 constructs, were modified to improve their clarity and relevance. The overall scale validity index for the questionnaires was, in order, .95 and .94. Following the cognitive interviews, the resultant teacher and student questionnaires were reduced to respectively 52 and 23 items. Furthermore, after the confirmatory analysis, the final version of the teacher questionnaire was reduced to 25 items to measure 6 constructs and the student questionnaire was reduced to 14 items to measure 3 constructs. Good-for-fit indices were established for the final model and Cronbach alphas of, in order, .89 and .81 were found for the teacher and student questionnaire. CONCLUSION: The valid and reliable curriculum viability inhibitor questionnaires for teachers and students developed in this study can be used by medical schools to identify inhibitors to achieve standards in different areas of the curriculum.

Exploring the relationship between emotion and cognitive load types during patient handovers.

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.

Attracting and retaining physicians in less attractive specialties: the role of continuing medical education.

BACKGROUND: Less attractive specialties in medicine are struggling to recruit and retain physicians. When properly organized and delivered, continuing medical education (CME) activities that include short courses, coaching in the workplace, and communities of practice might offer a solution to this problem. This position paper discusses how educationalists can create CME activities based on the self-determination theory that increase physicians' intrinsic motivation to work in these specialties. MAIN CONTENT: The authors propose a set of guidelines for the design of CME activities that offer physicians meaningful training experiences within the limits of the available resources and support. First, to increase physicians' sense of professional relatedness, educationalists must conduct a learner needs assessment, evaluate CME's long-term outcomes in work-based settings, create social learning networks, and involve stakeholders in every step of the CME design and implementation process. Moreover, providing accessible, practical training formats and giving informative performance feedback that authentically connects to learners' working life situation increases physicians' competence and autonomy, so that they can confidently and independently manage the situations in their practice contexts. For each guideline, application methods and instruments are proposed, making use of relevant literature and connecting to the self-determination theory. CONCLUSIONS: By reducing feelings of professional isolation and reinforcing feelings of competence and autonomy in physicians, CME activities show promise as a strategy to recruit and retain physicians in less attractive specialties.

The medical pause: Importance, processes and training.

Research has shown that taking 'timeouts' in medical practice improves performance and patient safety. However, the benefits of taking timeouts, or pausing, are not sufficiently acknowledged in workplaces and training programmes. To promote this acknowledgement, we suggest a systematic conceptualisation of the medical pause, focusing on its importance, processes and implementation in training programmes. By employing insights from educational and cognitive psychology, we first identified pausing as an important skill to interrupt negative momentum and bolster learning. Subsequently, we categorised constituent cognitive processes for pausing skills into two phases: the decision-making phase (determining when and how to take pauses) and the executive phase (applying relaxation or reflection during pauses). We present a model that describes how relaxation and reflection during pauses can optimise cognitive load in performance. Several strategies to implement pause training in medical curricula are proposed: intertwining pause training with training of primary skills, providing second-order scaffolding through shared control and employing auxiliary tools such as computer-based simulations with a pause function.

The effect of a three-dimensional instructional video on performance of a spatially complex procedure in surgical residents in relation to their visual-spatial abilities.

BACKGROUND: The effect of three-dimensional (3D) vs. two-dimensional (2D) video on performance of a spatially complex procedure and perceived cognitive load were examined among residents in relation to their visual-spatial abilities (VSA). METHODS: In a randomized controlled trial, 108 surgical residents performed a 5-Flap Z-plasty on a simulation model after watching the instructional video either in a 3D or 2D mode. Outcomes included perceived cognitive load measured by NASA-TLX questionnaire, task performance assessed using Observational Clinical Human Reliability Analysis and the percentage of achieved safe lengthening of the scar. RESULTS: No significant differences were found between groups. However, when accounted for VSA, safe lengthening was achieved significantly more often in the 3D group and only among individuals with high VSA (OR = 6.67, 95%CI: 1.23-35.9, p = .027). CONCLUSIONS: Overall, 3D instructional videos are as effective as 2D videos. However, they can be effectively used to enhance learning in high VSA residents.